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Abstract: When a spatial process is recorded over time and the obser- 
vation at a given time instant is viewed as a point in a function space, 
the result is a time series taking values in a Banach space. To study the 
spatio-temporal extremal dynamics of such a time series, the latter is as- 
sumed to be jointly regularly varying. This assumption is shown to be 
equivalent to convergence in distribution of the rescaled time series condi- 
tionally on the event that at a given moment in time it is far away from the 
origin. The limit is called the tail process or the spectral process depend- 
ing on the way of rescaling. These processes provide convenient starting 
points to study, for instance, joint survival functions, tail dependence coef- 
ficients, extrcmograms, extremal indices, and point processes of extremes. 
The theory applies to linear processes composed of infinite sums of linearly 
transformed independent random elements whose common distribution is 
regularly varying. 

AMS 2000 subject classifications: Primary 60G70; secondary 60G60. 
Keywords and phrases: Banach space, extremal index, extreme value, 
cxtrcmogram, exponent measure, linear process, regular variation, spectral 
measure, spectral process, tail dependence, tail process, time series. 

1. Introduction 

A powerful way to model spatio-temporal phenomena is by means of time se- 
ries of functional observations. Objectives of the analysis include inference on 
and prediction of certain functionals of the process, for instance the integral 
or the maximum of the process over a certain subregion. For risk management 
purposes, the interest is often in the extremal dynamics of such processes, both 
within space and over time. Examples from the literature include sea levels 
along dikes in the Netherlands (de Haan and Lin, 2001), windspeeds along the 
faces of a building (Davis and Mikosch, 2008), and precipitation in the state of 
Colorado (Cooley, Nychka and Naveau, 2007). 

Standard functional data analysis starts from the assumption of finite second 
moments and proceeds via the sequences of mean and autocovariance operators 
of the process (Bosq, 2000). The time series models in use are mostly linear. In 
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the heavy-tailed case, however, such an approach may be inadequate. Already 
in Davis and Resnick (1985), sample covariance functions of univariate linear 
processes with regularly varying, infinite variance innovations were found to 
have nondegenerate stable limits. Similar results for nonlinear processes were 
obtained in Davis and Mikosch (1998). 

While originally defined for univariate functions and random variables, the 
concept of regular variation has by now been extended to quite abstract settings, 
including the one of stochastic processes (Hult and Lindskog, 2005, 2006). In 
Davis and Mikosch (2008), the extreme- value behavior of a certain linear process 
with regularly varying innovations in Skorohod space was investigated. As for 
random variables, regular variation provides the mathematical backbone for 
a coherent theory of extreme values of random functions. By considering the 
functional observations as points in a suitable function space, we are led to 
consider regularly varying time series taking values in a Banach space. 

Our aim is to find a convenient way to express and study interesting tail- 
related quantities of time series of functional data, such as joint survival func- 
tions, tail dependence coefficients, extremograms (Davis and Mikosch, 2009), 
extremal indices and other characteristics of clusters of extremes. Moreover we 
aim at specializing these results to linear processes with regularly varying inno- 
vations. 

As in the finite-dimensional case (Basrak and Sogers, 2009), (joint) regular 
variation of a stationary time series (Xt)tez in a separable Banach space B is 
shown to be equivalent to the existence of the limit in distribution of the rescaled 
process 

(Xt/u)t£E conditionally on ||-X"o|| > it as « — > oo 

in the proper product space. The limit in distribution, denoted by (l*)tgz, is 
the tail process. It admits a familiar-looking decomposition into independent 
radial and angular components. The radial component is fully determined by 
the index of regular variation a of the random variable ||-^o||j while the an- 
gular component, called the spectral process, effectively captures all aspects of 
extremal dependence, both within space and over time. Specifically, the spectral 
process (0t)*ez is given by the limit in distribution of 

(A t /||A ||)t e z conditionally on [|X || > u as u — > oo. 

The distributions of the tail and spectral processes are uniquely determined by 
the ones of their restrictions to the nonnegative time axis. 

The property of regular variation turns out to be preserved under bounded 
linear operators. This allows us to study linear processes 

x t = Y^T i z t _ i , «ez, 

with (Zt)tez independent random elements in a Banach space Bj and Ti (i G Z) 
bounded linear operators from Bi to a second Banach space B2. If the common 
distribution of the innovations Zt is regularly varying and if the norms of the 
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operators Ti satisfy the summability condition (7.2) below, the series (X t )tez is 
regularly varying in B2 . Its spectral process reflects the common extreme- value 
heuristic that large values in the series most likely arise from a single large shock 
among the innovations. 

All in all we find that the spectral process provides a convenient, natural, 
and unifying concept for expressing and studying extremal characteristics of 
regularly varying time series in infinite-dimensional spaces. A next step could 
be to reevaluate certain methods from functional data analysis when basic mo- 
ment assumptions are violated and are replaced by the assumption of regu- 
lar variation. Finally, note that in some of our results, the vector space struc- 
ture of the Banach space B does not come into play, so that certain parts of 
the theory might even be carried over to more general spaces such as cones 
(Davydov, Molchanov and Zuyev, 2008; Hult and Lindskog, 2006). 

The paper is organized in two parts. In the first part, Sections 2-5, the 
theory of regular variation of random elements and stationary time series in 
real, separable Banach spaces is developed in general. The emphasis is on the 
properties and the use of the spectral process. In the second part, Section 6-9, 
the effect of bounded linear operators on regular variation is investigated, with 
applications to infinite random sums and linear processes with regularly varying 
innovations. Some auxiliary results are relegated to the Appendix. 

2. Regular variation 

Regular variation of probability measures on Euclidean space is usually defined 
in terms of vague convergence of a sequence of Radon measures, living on Eu- 
clidean space compactified at infinity and punctured at the origin (Rcsnick, 
2007). For Banach spaces B that arc not locally compact, such an approach 
does not work. A possible way out is to replace vague convergence by w- 
convergence described in Daley and Vere- Jones (1988). This, however, requires 
changing the metric on B and completing it at infinity (Davis and Mikosch, 
2008; de Haan and Ferreira, 2006; de Haan and Lin, 2001; Hult and Lindskog, 
2005). These steps are not needed in the approach of Hult and Lindskog (2006) 
based on Mo-zero convergence, which we follow here. In addition, we provide a 
number of characterizations of regular variation that are purely probabilistic. 

Let B be a real, separable Banach space. For r > 0, let Bq^ u = {x € B : ||a;|| < 
u] be the open ball in B centered at with radius u. Let M = M (B) be the class 
of Borel measures on B = B\{0} whose restriction to M\B u is finite for all u > 
0. Put ^0 = ^oW the class of bounded and continuous functions / : B — > K for 
which there exists u > such that / vanishes on Bq^ u . A sequence of measures 
/i„ in Mo converges to \i in Mo if and only if lim„_ s . 00 J f dfi n = J f dfi for all 
/ € ^b- Essentially, convergence in Mo is equivalent to weak convergence of finite 
measures when restricted to B \ Bq u for all but at most countably many u > 0. 
The topology of Mo-convcrgence is metrizable, turning Mo into a complete, 
separable metric space. Versions of the Portmanteau theorem, the continuous 
mapping theorem, and Prohorov's theorem hold; see Hult and Lindskog (2006, 
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Section 2). Finally, let RV T be the class of functions that are regularly varying at 
infinity with index r € K, that is, the class of measurable functions / : (0, oo) — > 
(0, oo) such that lim tl _> 00 f(ux)/f(u) = x T for all x > 0. 

A random element X in B is regularly varying with index a > if there exists 
a nonzero \i £ Mq and a function V £ RV- a such that 

P(w _1 X 6 • ) n (u -> oo) in M . (2.1) 



V(u) 



The limit measure fi is defined up to a multiplicative constant only and it 
satisfies the homogeneity property /J-(rA) = r~ a fi(A) for every r > and Borcl 
set A C B . Let S = {9 G B : ||0|| = 1} denote the unit sphere in B. By 
homogeneity, fx(B) — 0. Equation (2.1) and the Portmanteau theorem then 
imply 

P(||X|| > u)/V{u) -> fi({x e B : ||a;|| > 1}) =: c ^ (u -> oo). 

For /i as in (2.1), define a probability measure A on § by 

A(A) = c" 1 ^({x G B : ||x|| > 1, x/||a;|| G A}), Borcl sets A C §. 

We call A the spectral (probability) measure of X. Put 

T : (0, oo) x § — !> B : (r, 0) H> rd (2.2) 

and let be the measure on (0, oo) given by v a (dr) = d(—r~ a ) = ar -0 " 1 dr 
for r > 0. We have 

H = c(v a ® X)oT-\ (2.3) 
with '®' denoting product measure, an expression which is equivalent to 



fdfi = c / f(r6)d(-r- a )\(d6) (2.4) 
Js Jo 

for all /x-integrable / : Bo — > M. 

In the following proposition, we provide three characterizations of regular 
variation in terms of weak convergence of probability distributions. Let Pareto(a) 
denote the Pareto distribution with parameter a, that is, the distribution of a 
positive random variable Y with tail function P(Y > y) = y~ a for y ^ 1. By 
jSf (Z) we mean the law of a random element Z, and Jzf (Z | A) denotes the law 
of Z conditionally on the event A. Let the arrow '~~>' denote convergence in 
distribution and let 1(A) denote the indicator variable of the event A. 

Proposition 2.1. Let X be a random element in B, let a > 0, and let A be 

a probability measure on the unit sphere S in B. The following statements are 
equivalent: 

(i) X is regularly varying with index a > and spectral measure A. 

(ii) The function u H y P(||X|| > u) belongs to RV- a an d 

&{X/\\X\\\\\X\\>v)~*\ («->oo), inS. 
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(iii) In (0, oo) x §, we have 

^(\\X\\/u, X/\\X\\ | \\X\\ >u)~* Parcto(a) ® A (u -> oo). 

In B, we /law, wz£/i T as in (2.2), 

jSf (X/ti | ||X|| > u) (Parcto(a) ® A) o T" 1 (u -> oo). 

Proof, (i) implies (ii). As explained in the paragraph following (2.1), a pos- 
sible choice for V in (2.1) is V(u) = P(||X|| > it), in which case n{{x £ 
B : 1 1 a; || > 1}) = 1. Let g : § — > M. be bounded and continuous and put 
f(x) = g(x/\\x\\) l(\\x\\ > 1) for x £ Bo. The discontinuity set of / is con- 
tained in S, which is a /i-null set. Hence by Lemma A.l and equation (2.4), as 
u — > oo, 



E[ffpr/||*||)|||X||>u] 



1 



V(u) 



W(X/u)} 



fdfi 



gdX. 



(ii) implies (Hi). Let y ^ 1 and let g : 
By (ii), as n ^ oo, 

E[l(\\X\\/u>y)g(X/\\X\\)\\\X\\>u] 

_ P(\\X\\>uy) 



be bounded and continuous. 



P(ll*ll>«) 



E[g(X/\\X\\) | ||A1 > uy] -> y~ a f g(9) X(d6). 

Js 



In view of Lemma A. 2, this implies (iii). 

(Hi) implies (i). Let / £ ^q. Let z > be such that / vanishes on i?o,z- Put 
V(u) = P(\\X\\ > u). The weak convergence relation 3f(\\X\\/u \ \\X\\ > u) -w 
Pareto(a) as u — > oo implies V £ RV- a . Let (Y,Q) be a random element in 
(0, oo) x § with distribution Pareto(a) ® A. We have 



1 



V(u) 



Hf(x/u)} = 



i 



V(uz) 
V{u) 



E[f(X/u)\{\\X\\ >uz)\ 

x\\ X 



E 



uz X 



\X > uz 



z- a E[f(zYO)} 



as u — y oo. By Fubini's theorem, the limit is equal to 



f{zy6)d{-y- a )X{d9)= / / f{r6) d(-r~ a ) X{d6) 
i Js . 



f(r0)d(-r- a )X(d6). 



s Jo 



We obtain (2.1) with fi as in (2.3). 

(iii) implies (iv), and (iv) implies (ii). By applications of the continuous 
mapping theorem, upon noting that 



X 
u 



u \\X\ 



and 



X 

W\ 



X/u 

\X/u\ 



□ 
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3. Spectral process of a stationary time series 

Let (Xtjtzz be a (strictly) stationary time series in a (real) separable Banach 
space B. The time series is said to be (jointly) regularly varying with index a > 
if for every positive integer k the vector (X±, . . . , X k ) is regularly varying with 
index a in the Banach space M k . One possible choice for the norm on B fc is 
||(xi, . . .,x k )\\ = maxdlxiH,. . . , ||x fc ||). 

According to the definition above, there exist sequences of measures fi k in 
Mq(M ) and functions V k 6 RV- a such that for every positive integer k, 

P[(u- 1 X 1 ,...,u- 1 X k )e •]->■/** (u^oo) inM (B fe ). 



V k (u) 

These limiting measures give rise to spectral measures X k on , the unit sphere 
in M k . Although these spectral measures originate from a single, stationary pro- 
cess, it is awkward to describe how they are related because the spheres on 
which they live arc of different dimensions. Therefore, we seek an alternative 
description in terms of a single object. 

In the following, B z denotes the space of sequences (xt)tgz m B endowed 
with the product topology, that is, the topology of elementwise convergence. In 
B z , convergence in distribution is equivalent to convergence in distribution in 
B fc of all finite stretches of length k, for every positive integer k (convergence 
of finite-dimensional distributions, so to speak, except that the dimension of a 
single B may already be infinite). By convention, max0 = 0. 

Theorem 3.1 (Spectral process). Let (X t )tez be a stationary time series in B 
and let a > 0. The following statements are equivalent: 

(i) (-X't)teZ * s regularly varying with index a. 

(ii) The function u t— > P(||A || > u) belongs to RV- a and here exists a random 
element (Ot)tez in B z such that 

J?((X t /\\X \\) teZ | ||X || > u) ^ (Q t ) t& (u oo). 

(Hi) There exists a random element (0t)tez in B z such that in (0, oo) x B z , 

&{\\X \\/u, (AV ||A ||) teZ I ||Ao|| > u) - (Y, (0t)t 6 z) (« -> oo), 

where Y is a Parcto(a) random variable independent from (&t)tez- 
(iv) There exists a random element (0t)tez in B z such that 

J?((X t /u) t£Z | ||A || > u) {YQ t ) t& (u -y oo), 

where Y is a Pareto(a) random variable independent from (0t)tgz- 

In this case, the object (0t)tgz is the same across (ii)-(iv) and for every positive 
integer k, 

P[(X 1 /u,...,X k /u) e •] -> !i k (u^oo) (3.1) 



V{\\X Q \\>u) 
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in M (B k ), where J fdfj, k for f G %(M k ) is given by 



El E 

3=1 J ° 



f(O,...,0,rQ o ,...,rQ k - j )l[ max 116,11=0 

j + l^i^ — 1 



d(-r- a ). 



The limit process (0t)tez is called the spectral process of (X t ) te z. The spec- 
tral process provides a unifying concept for a great variety of tail-related objects, 
see the examples of its use in Section 5. 

Note that Oo is an §- valued random element with law equal to the spectral 
measure of the common distribution of the random elements Xt. The process 

(y t ) tez = (ye t ) tez (3.2) 

in item (iv) is called the tail process of (X t ) te z. Since ||Oo|| = 1, we have 
Y = \\Y \\ and Q t = Y t /\\Y \\ for all t £ Z. 

Proof of Theorem 3.1. (i) implies (ii). By stationarity of (Xt)tez and regular 
variation of (Xi, . . . , Xk) in M k , it is not difficult to see that the limit 

Um P(||X ||>u) 



^P[max(\\X 1 l...,\\X k 



exists and is in [1/k, 1] for every integer k ^ 1. As a consequence, a valid choice 
for the auxiliary function in the definition of regular variation of (^i, . . . , X k ) 
is just u i y P(||Xo|| > it), independently of k, yielding 

¥[{X x /u,...,X k /u) e •] ->/i fc (u->oo) (3.3) 



P(||X || >«) 

in Mo(B fc ). With this normalization, the limit measure ix k satisfies 
» k ({(xi,...,x k ) GB fe : H^-ll > 1}) = 1, j e 
Let s, t be nonnegative integers and write = £ + s + 1. Put 

§ M = {(0_ s ,...A)eB fc :||fl o || = l} (3.4) 
and define a probability measure A s t on S fl) t by 

X s ,t(B) =fi k ({(x- s ,...,x t ) £B fc : 

Uxoll > 1, (x_ s /||x ||,...,Vlko||)e5}) (3.5) 

for Borel subsets B C § s f Let g : § s t — > R be bounded and continuous and 
define / : M k ->■ R by 

f(x- a ,...,x t ) = g(x- s /\\x \\, ■ ■ . ,x t /\\xo\\)l(\\xo\\ > 1) 



T. Meinguet and J. S eg ers/ Regularly varying time series in Banach spaces 



8 



to be interpreted as if xq — 0. The function / is bounded, vanishes on the 
unit ball in M k , and is continuous everywhere except perhaps on S Si t, which is 
a /Xfc-null set. As a consequence, by Lemma A.l, 



E[g(X_ s /\\X \ 



>x t /\\x \ 

1 



P(ll*o||>tO 



X \\ >u] 
E[/(*_./u, 

fdfi k 



Xt/u)] 

g dX s , t 



That is, if (0_ a , 
Sf(X-„/\\X \ 



(u — > oo). 

, Q t ) is a random element of § Si t with distribution A s .t, then 

.,X t /\\X \\ | ||Xo|| >«)^(e_a,...,e t ), 



By the Daniell-Kolmogorov extension theorem (Pollard, 2002, Chapter 4, The- 
orem 53), there exists a random element (Qt)teZ in B z such that the distribu- 
tion of (O-s, ■ • ■ , ©t) is A Sj t for all nonnegative integers s and t. Weak conver- 
gence of finite stretches characterizing weak convergence in the product space 
B z (van der Vaart and Wellner, 1996, Theorem 1.4.8), statement (ii) follows. 

(ii) implies (Hi). Let s and t be nonnegative integers, let y ^ 1 and let 
g : S Si t — > R be continuous and bounded, with S Si t as in (3.4). We have 



E[l(\\X \\/ U >y)g(X_ s /\\X \ 
_ P(\\X \\ >uy) 
' P(||X ||>u) 



,X t /\\X \\)\\\X Q \\> U ] 
E[g(X-sl\\X l...,X t /\\X Q \\) | \\X \\>uy] 

-^y- a E[g(e_ S) ...,e t )] (u->oo) 



In view of Lemma A. 2, we find, as u — > oo, 

&(\\x \\/u,x- a /\\x \\,...,x t /\\x \\ | ||x || >«) (r,e_ s ,...,e t ), 

with Y a Pareto(a) random variable independent of (&- s , • ■ • , ©*)■ Statement 
(iii) follows. 

(Hi) implies (i) and (3.1). Let k be a positive integer, and let / G 1^o(M k ). 
There exists z > such that / vanishes on the ball i?o,z in B fc , that is, 
f(xi, . . . ,Xk) = whenever ||xj|| < z for all j G {1, ...,k}. Put V(u) = 
P(||Ao|| > u), a function which by (iii) is in RV- a . Decomposing the event 
{maxi^j^fe \\Xj\\ > uz} according to the smallest j such that \\Xj\\ > uz, we 
find 



1 



V(u) 



E[/(A 1 / U ,...,A fc / U )] 



V(u 
V{uz 



1 k 

(ih\ ^ 

3 = 1 
k 



f(X 1 /u,...,X k /u)l\\\X j \\>uz> max \\X t 

l^i^j— 1 



fiXx/u, . . . , X k /u) 1 max \\Xi\\ < uz 



|Xj|| > uz 
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By stationarity, the terms in the final sum in the above display are equal to 



E 



f(X 1 -j/u,...,X k -j/u)l[ max ||JQ|| < uz 

— j+i^^— 1 



IX, II > uz 



for j 6 {1, ... , k}. Writing 



x i = _ \\x \\ x t 

u uz \\Xq\\ ' 



we find, by (iii) and by continuity of the Pareto(a) distribution, 
Um -^E[f(X 1 /u,...,X k /u)] = 

U-tOO V (U) 



3=1 



E 



f{zy®i-j,...,zy®k-j)M max \\y®i\\ < 1 

— j+i^i^— i 



d(-y- a ). 



The substitution r — zy and the fact that / vanishes on the ball £?o, 2 in M k 
yield 

1 



lim 
u->oo V(u) 

k 



3=1 Jz 



3=1 J ° 



E[f(X 1 /u,...,X k /u)] 

/(rei_ i ,...,re fc _ 3 )l( max \\rG t \\ < z 

/(r8i_j,...,r8fc-j)l( . max J|r6j|| < z 



d(-r~ a ) 



d(-r- Q ). 



Since this is true for all positive z in a neighbourhood of zero, we obtain, by 
dominated convergence, 



1 



lim _yr ^rE[f(X 1 /u,...,X k / U )] 



k 



^ E 

j=i 1/0 



/(0,...,0,reo,...,re fc _ i )l max 116,11=0 

— j + l^i^ — 1 



d(-r~ Q ). 



We obtain (iii) as well as (3.1). 

(iii) implies (iv), and (iv) implies (ii). By applications of the continuous 
mapping theorem. □ 

Example 3.2 (Asymptotic independence). Assume that the common distribution 
of the random elements Xt is regularly varying with spectral measure A and that 
||Ao|| and ||-Xt|| are asymptotically independent for each nonzero integer t in the 
sense that 

lim P(||X t || >tt| ||X || >«) = 0. 

u— >oo 

Then the time series {Xtjt^z is regularly varying with spectral process (Qt)tez 
with ££ (80) = A and 8t = almost surely for every t £ Z \ {0}. 
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4. The time-change formula 

In general, the spectral process (®t)t£Z of a stationary regularly varying time 
series (X t )tez is itself nonstationary. Still, the fact that (Xt)tez is stationary 
induces a peculiar structure on the distribution of the spectral process. In par- 
ticular, the distribution of (0t)tez is determined by the distribution of its re- 
striction to the nonnegative time axis, that is, of the forward spectral process 
(0t)tez+, with Z+ = {0,1,2,...}. The same is true for the backward spectral 
process (0t) te z_, with Z_ = {0, -1, -2, . . .}. 

Theorem 4.1. Statements (ii)-(iv) in Theorem 3.1 are equivalent to the same 
statements with Z replaced by Z+ or Z_ . In that case, 



E[/(9_ s ,...,6 t )] =E 



_©o_ ©t+s | 

' "eji'-'iie ." 



(4.1) 



for all nonnegative integer s and t and for all integrable functions f : B t+S+1 — > 
K that have the property that f(Q_ s , . . . , 9 t ) =0 whenever 8_ s = 0. 

The proof of Theorem 4.1 is given below. Note that by considering the time- 
reversed process X t = X_ t , equation (4.1) can be reversed in the obvious way. 

Some examples of the time-change formula (4.1) are given in Examples 5.1 
and 5.2. A simple case occurs when / only depends on its first component, that 
is, when f(9- s , ■ ■ ■ , &t) = f(8-s) and f(0) = 0: equation (4.1) then reduces to 

E[/(e_.)] = £?[/(e /||e a ||) iie.n, sez. (4.2) 

This yields an expression of the distribution of 0_ s in terms of the joint law of 
0o and Q s . In particular we find 

P(0_ S ^O)=E[||0 S |H, sez. 

If the common value in the preceding display is equal to unity, then (4.2) is 
valid for arbitrary integrable /, that is, without the restriction that /(0) = 0. 

Proof of Theorem J^.l. By symmetry, we only need to consider the forward case, 
Z + = {0, 1,2,.. .}. Consider the statements (ii) and (iii) in Theorem 3.1 with Z 
replaced by Z + : 

(ii + ) The function u i-> P(||Xo|| > u) belongs to RV- a and in B z +, 

(p£V||X ||)t 6Z+ | pToll > u) - (00*62+ (« -> oo). 
(iii+) In (0, oo) x B z +, as u — > oo, 

JSf(||Xo||/u,(X t /||X ||)t 6 z + I \\Xq\\>u) - (F,(0 4 ) teZ +), 



where Y is a Pareto(a) random variable independent from (0t)tez+- 
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We have to show that the statements (i)-(iv) in Theorem 3.1 are equivalent 
with each of (ii+) and (hi+). We already know that (i) implies (ii). Trivially, (ii) 
implies (ii+). To show that (ii+) implies (hi+), just set s = in the part of the 
proof of Theorem 3.1 that (ii) implies (iii). Since (iii) implies (i) by Theorem 3.1, 
all that remains to be shown is that (iii+) implies (iii). As before, the version of 
statement (iv) with Z replaced by Z+ is dealt with via the continuous mapping 
theorem. 

Claim 1. If (iii+), then for every t e Z + , 

E[||e t |n=hm lim P(||*_ t ||>ru|||*o||>«). 

rj.0 u— »oo 

Proof of Claim 1. Fix t <E Z+ and r > 0. Put V{u) = P(||X || > u). By station- 
arity and (iii— t— ) , since Y and ©t are independent and the distribution of Y is 
continuous, 

P(||X_ t || > ru | ||Xo|| > u) = ^ P(||X t || > u | ||Xo|| > ru) 



r - a P(rY\\e t \\ > 1) (u->oo). 



By independence, this is equal to 



E 



l(ry\\Q t \\>l)d(-y- a ) 



E 



i(z||e t || > i)d(- z - a ) 



= E[min(||9 t ||,l/r) Q ]. (4.3) 



By monotone convergence, the limit as r I is E[||8t|j Q ], as required. □ 
Claim 2. If (hi+), then for every t E Z+, 

&{X_ t /\\X Q \\ | ||X || >u)^v t («->oo), 

where vt is a probability measure on M given for ^f-integrable g : B — > M by 

g dv t = s(o)(i - E[||e t n) + E[ff(eo/||e t ||) ||e t n. 

(The expectation on the right is to interpreted as zero if ||©t|| = 0.) 

Proof of Claim 2. Let g : B — > M be continuous and bounded. Fix r > (later 
on, we will take the limit as r 4- 0) . We have 

E[<7(X_ t /||Xo||) | ||X || >u] 

= g(0) P(||X_ t || < ru | ||X ||>u) 

+ E[{g(X_ t /\\X \\) - g(0)} l(||X_ t || < ru) \ \\X \\ > u] 

+ E[g(X_ t /\\X \\)l(\\X_ t \\>ru) \ \\X \\ > u}. 



T. Meinguet and J. S eg ers/ Regularly varying time series in Banach spaces 



12 



The first term on the right-hand side has been treated in Claim 1. Secondly, if 
\\X \\ > u and ^5 ru, then ||X_ t /||X || || < r. Since g is continuous, 

Hmlimsup|E[{ 5 (X_ t /||^o||)-5(0)}l(||X_ t || < m) | pT || >«]| 

r 4-0 u— >oo 

^ lim sup \g(x) - g(Q)\ = 0. 

r i0 x eBo, r 

Thirdly, writing V(u) = P(||Xo|| > u), we have, by stationarity, 
E[g(X- t /\\X \\) l(\\X_ t \\ > ru) \ \\X \\>u] 

U) mx^/\\X t \\)l{\\X t \\ >u) I \\X \\>ru] 



V(u 



V(ru) E 



X 4 ||/||X ||y V ru \\X \ 



By (ih+), continuity of the law of Y and independence of Y and Ot, this con- 
verges as u — > oo to 

r- Q E[ 5 (e /||e t ||)i(ry||e t || >i)] 

By the same argument as in (4.3), this is equal to 

E[ 5 (e /||e t ||)min(||e t ||,l/r) Q ], 

which tends to E[<?(8o/||0f ||) ||0t|| a ] as r J. (dominated convergence). Claim 2 
is thereby established. □ 

Fix nonnegative integer s and t. If (ih+), then in view of Claim 2, the converse 
half of Prohorov's theorem (Billingslcy, 1999, Theorem 6.2) and Tychonoff's 
theorem, there exists uq > such that the collection of probability measures 

&(X- B /\\X \\,...,X t /\\X \\ | pColl > u), u>u , (4.4) 

is tight, that is, for every e > there exists a compact subset K £ of B* +s+1 so 
that the probability mass of K e under each of the laws above is at least 1 — e. 
By the direct half of Prohorov's theorem (Billingslcy, 1999, Theorem 6.1), the 
collection of probability measures above is relatively compact: for every sequence 
u n — > oo there exists a subsequence u„ m —> oo for which the laws have a limit in 
distribution. To prove convergence in distribution of (4.4) as u — > oo, it is then 
sufficient to show uniqueness of the possible sequential limits. As probability 
distributions are determined by their integrals of bounded, Lipschitz continuous 
functions (Billingslcy, 1999, proof of Theorem 1.3), it is sufficient to show the 
following claim. 

Claim 3. If (ih+), then for every nonnegative integer s and t and for every 
bounded, Lipschitz continuous function / : B t+S+1 — )• R, the following limit 
exists: 

lim E[f{X_ s /\\X \\,...,X t /\\X \\) | ||X 1| >«]. (4.5) 
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Proof of Claim 3. We proceed by induction on s. If s = 0, there is nothing to 
prove, for (iii+) already states convergence in distribution as u — > oo. 

Let s ^ 1 be integer and assume the stated convergence holds for s — 1, 
all nonnegative integer t, and all bounded, Lipschitz continuous functions from 
M t+S into K. Let / : B t+S+1 -> K be bounded and Lipschitz continuous. Define 
fo : B t+S+1 -> R by 



E[/(X_ s /||X ||,...,X t /|LY ||) | ||X„||>u] 

= E[/ (X_ S /||X ||,...,X 4 /||X ||) | ||X ||>u] 

+ E[/(0,X_ s+1 /||X ||,...,X t /||Xo||) | ||Xo|| >«]. 



exists. It remains to show the existence of the limit in (4.5) with / replaced by 
fo. Besides being bounded and Lipschitz continuous, the function fo has the 
additional property that /o(0, #- s +i, • ■ • , 0t) = 0. 

Let r > (later on, we will take the limit as r 1 0). Write 



E[/o(X_ s /||X ||,...,X t /||X ||) | ||X || >u] 

= E[/o(X_ s /||Xo||,...,X t /||X |[)l(|[X_ s || ^ru) \ \\Xo\\>u] 

+ E[/o(X_ s /||Xo||,...,X 4 /||Xo||)l(||X_ s || >ru) \ \\X \\ > u]. 



Let L be the Lipschitz constant associated to fo. Consider the first expectation 
on the right-hand side of the previous display. Since the integrand vanishes if 
X- s = 0, this expectation is bounded by L \\X- a \\/\\Xo\\ < Lr, which converges 
to as r 1 0. So it remains to show existence of the limit of the last expectation 
in the previous display as u — > oo and then as r 1 0. 
Let V(u) = P(||Xo|| > u). By stationarity, 



f (6- s ,...,6 t ) = f(6- s ,...,6 t )-f(0,6 



-s+l 



We have 



By the induction hypothesis, the limit 



hm E[f(0,X. s+1 /\\Xol...,X t /\\Xo\\) \ \\X \\ > u] 



11 




v(u) [ /0 Viix s ||/iixoii'---'ii^ii/ii^oiiy 




In view of (iii+), this converges as u — > oo to 
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By a similar argument as the one at the end of the proof of Claim 1, this is 
equal to the left-hand side in 



E 



fo 



©n 







t+s 



|e s ||""-'||e s 



min(||e s ||,l/r) c 

e 



E 



fo 







t+s 



|e.| 



10, 



I©., 



(r|0), (4.6) 



the convergence being justified by dominated convergence. This finishes the 
proof of Claim 3. □ 

By Claim 3 and the tightness argument preceding it, if (iii+) then the limit 
in distribution 



Jf(X-J\\X \ 



,X t /\\Xo\\ I \\X \\ >u) 



exists for all nonncgative integer s and t. By the Danicll-Kolmogorov extension 
theorem (Pollard, 2002, Chapter 4, Theorem 53), these limits in distributions 
are the 'finite-dimensional' distributions of a random element (0t)tez in the 
product space B z . Statement (iii) concerning weak convergence in B z then fol- 
lows from the convergence in the previous display for all s and t together with 
Theorem 1.4.8 in van der Vaart and Wellner (1996). 

It remains to show equation (4.1). By (4.6), equation (4.1) holds if / is 
bounded and Lipschitz continuous and vanishes on the set {(9— s , . . . ,0t) S 
jgt+s+i . _ q|_ p or a g enera i bounded and Lipschitz continuous function 



g : B t+S+1 -+ M, write 



? (0- 8 , ...,©*) = g(Q- s , ...,©*)- g(o, e_.+i, . . . , e t ) 

+ 3(O,0- s+ i,...,0 t )-.9(O,O,0_ s+2 , 



0*) 



+ g(0, . . . , 0, 0_ 1; . . . , 6 t ) - ,g(0, . . . , 0, ©o, . . . , t ) 
+ g(O,...,O,0 o ,...,0 t )- 

Take expectations on both sides and apply (4.6) to the first s lines of the right- 
hand side of the previous display at s replaced by s,s — 1, . . . , 1, respectively, to 
obtain 



E[g(e. 
= E 

+ E 
+ . . 

+ E 



e 



9 



9i 



9 



e.ir'"' ||e.||; 3 V"'lie s 

Oo Qt+s-i 



lie.i 



g[ o,...,o, 



e._iir ' ||e._i 
e e*+i 



9\ 0,0, 



0i 



|e.|| a 

04+s-l 



ii0iir 'ii0ii 

+ e[ s (o,...,o, e ,...,e t )]. 



9\ 0,...,0, 



e.-iH''"' ||e,_i 

0i ©t+i 



|0i 



'' Il0il 



|0«-i| 



|0i T 
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The equality in the preceding display being true for all bounded and Lipschitz 
continuous functions g : M t+S+1 — > R, it must hold whenever g is the indicator 
function of a closed set (Billingsley, 1999, proof of Theorem 1.3) and then by a 
standard argument for all measurable functions B* +s+1 — > R that are integrable 
with respect to the law of (0- s , . . . , Ot). For such functions that vanish when- 
ever their first argument is equal to zero, the formula in the preceding display 
simplifies to (4.1). 

This concludes the proof of Theorem 4.1. □ 



5. Use of the spectral process 

Various aspects of the extremal dynamics of a regularly varying stationary time 
series can be expressed in terms of its spectral process. Here we give examples 
involving joint survival functions, tail dependence coefficients, the extremogram, 
extremal indices, and point processes. In Basrak, Krizmanic and Segers (2010), 
the spectral process is also used to prove a functional limit theorem for partial 
sums of real-valued stationary time series with infinite variance. 

Let (X t ) tg z be a stationary time series in a separable Banach space B with 
dual space B*, that is, the linear space of bounded linear functionals b* : B — > M 
equipped with the norm ||6*|| = sup{|6*a;| : x G §}. Assume (X t ) tt£ z is regularly 
varying with index a and spectral process (&t)tez- Let (Yt)tgz be the tail process 
of pr t ) teZj see (3.2). 

Example 5.1 (Joint survival functions). Fix an integer t ^ 0, an index set 
I C {0, . . . , t} such that £ I, and nonzero bounded linear functionals b* £ B* 
(i G I). We are interested in the joint tail behavior of the random variables b*Xi 
for i G /. By conditioning on the event ||-X"o|| > w /ll^oll' we nno - 

lim P(V ^n J y : ft! r ~ = " 6 «H Q p ( Vl e 1 : b ^ > 

u^oo P(||Ao|| > U) 

POO 

= P(Vi G I : rb*Q l > l)d(-r- a ) 

= E[mm{(6jei)^ :*€/}]. 

If we had started to calculate the limit on the left-hand side of (5.1) by condi- 
tioning on the event \\X t \\ > instead, we would have found 

lim P(V pf|| / y !ff r U) = E[min{(6* 0i _ t )« : i G 7}]. (5.2) 

u^oo P(||Ao|| > U) 

The equality of the two expectations in equations (5.1) and (5.2) is a special 
instance of the time-change formula (4.1). 

In the same way, one can prove that for t and I as above and for positive 
constants bi (i G I), 

m ei^x t \\ >u) = E[mHb?ma :ieI}] (5 . 3) 

= E[mm{b?\\Q l - t \\ a : i G /}]. 
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Example 5.2 (Tail dependence coefficients). Let b* G B*. If P(&*9 > 0) > 0, 
then the coefficient of upper tail dependence between b*Xg and b*Xh is given 
by 

V V!h*Y ^ \k*Y ^ ^ E[min{(&*9 )», (6*9^)"}] 

hm PJI k >u iil > u = ^r/^n wi — ( 5 - 4 

«->oo E[(0*9o)"J 

E[min{(&*9 )^, (fr*9_^}] 
E[(6*0 O )£] 

This is an immediate consequence of equations (5.1) and (5.2). Likewise, by 
(5.3), the coefficient of tail dependence between ||-X"o|| and \\Xh\\ is given by 

lim P(||X fe || >u\\\X \\> u) = E[min(||e h |r, 1)] = E[min(||e_ h || ' ) 1)]. 

u— >oo 

Example 5.3 (Extremogram) . In Davis and Mikosch (2009), the extremogram 
was introduced as an extreme- value analogue of the correllogram through 

PA,B{h) = lim n P(X /a n G A, X h /a n G B), 

n—>oo 

for integer h and for regions A, B at least one of which stays away from the 
origin and where a n is a positive sequence satisfying nP(||Xo|| > a n ) — > 1 as 
n — > oo. For instance, if A = {x G B : a*x > 1} and B = {x G B : b*x > 1} for 
some a*,b* G B*, then by (5.1), 

PA . B (h) = lim n P(a*X > a n> b*X h > a n ) = E[min{(a*9 )^ (b*Q h )%}}. 

More generally, if A and B are continuity sets of the distributions of Yq and Yh 
respectively and if A C {x G B : ||x|| > 1}, then 

PA,B(h) = lim P{X /a n G A, X h /a n G B \ \\X a \\ > a n ) 

= P(y e A, Y h g B). 

Example 5.4 (Extremal indices). Let b* G B* be such that P(6*9o > 0) > 0. Un- 
der assumptions similar to Conditions 4.1 and 4.4 in Basrak and Segers (2009), 
the extremal index (Leadbetter, 1983) of the univariate sequence (6*X t ) te z is 
given by 

8{b*) = lim lim PI max b*X t ^ u 

ra— foo u— ¥oo \ t—1 ,m 



= 1 - 



b*X > uj (5.5) 

E[min{(b*e )^,sup^ 1 (6*9Q^}] 
E[(6*0 o ft] 
E[ S u Pf>0 (b*e t )^-sup t>1 (6*e t )^] 
E[(&*9 )^] 

In the previous display, the second equality is justified by an argument similar 
to the one in (5.1), whereas the last equality is a consequence of the identity 
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x — min(a;, y) = max(x, y) 
univariate sequence (||^t|| 



- y for x, y S ffi. Similarly, the extremal index of the 
tG z is given by 



lim lim P 



max 

t— l,...,m 



\X t \\^u 



\X \\>u 



p(sup||y t || < i 



E 



sup||e||"-su P ||e|r 

t>0 t>\ 



(5.6) 



see Basrak and Segers (2009, Remark 4.7). 

Example 5.5 (Point processes). Consider the sequence of point processes 



N„ 



»=i 



with a„ a positive sequence such that nP(||X || > a n ) — > 1 as n — > oo. We 
view N n as a random point measure in Mq. For Euclidean state spaces, the 
limit distribution of N n has been studied in, among others, Davis and Hsing 
(1995), Davis and Mikosch (1998), and Basrak and Segers (2009). Under con- 
ditions similar to the ones of Theorem 4.5 in Basrak and Segers (2009), it can 
be shown that N n converges weakly to a certain compound Poisson process N. 
The clusters in N are rescaled independent copies of the cluster process whose 
law is equal to 



sup 
t<-i 



11*11 «J 1 



Up to minor changes, the proof is the same as in Basrak and Segers (2009) and 
is omitted for brevity. 



6. Bounded linear operators 

Let Bi and B2 be real, separable Banach spaces. We consider the effect of a 
bounded linear operator A : Bi — > B2 on the regular variation properties of 
a Bi-valued random clement X (Proposition 6.1) and a stationary time series 
(Xt)tez (Proposition 6.3). The case of bounded linear functionals arises when 
B2 = K. We do not pursue generalizations of Breiman's lemma involving op- 
erators that are themselves random; see e.g. Basrak, Davis and Mikosch (2002, 
Proposition A.l) for the finite-dimensional case. 

Let §, denote the unit sphere in Mj (j = 1,2). The norm in both Banach 
spaces will be denoted by the symbol || ■ ||. 

Proposition 6.1 (Linear transformation of random elements). Let X be a 
regularly varying random element in Bi with index a > and spectral measure 
A and let A : Bi — > B2 be a bounded linear operator. We have 



(6.1) 
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If X({9 £ Si : AO 7^ 0}) > 0, this limit is positive and AX is regularly varying 
in B 2 with the same index a and with spectral measure \a given by 

■'«» A ^> ' ^wFm lAm) mr Hd6) - (6 - 2) 

for \A~integrable g : §2 R- (For 9 such that \\A9\\ = 0, the integrand on the 
right is to be interpreted as zero.) 

Proof. Let \x be the limit measure of X when V(u) = P(||X|| > u); see (2.4). As 
/1 is homogeneous, the set {x £li : \\Ax\\ = 1} is a /i-null set. As a consequence, 

as«-> 00, 

P(\\AX\\ >u) , r m „ „ 

p"iiW>«) ^ /i({a€Bi:||AB||>l}) 

l(r\\A9\\ > l) d{~r- a ) \{d9) = / ||A6>|| Q A(d<9). 



If A({0 : A# 7^ 0}) > 0, the integral on the right is positive. Let / E %(M 2 ) and 
let z > be such that / vanishes on the ball £? , z in B 2 . Since A is bounded, 
the function Bi — > K : x i-» f(Ax) belongs to ^o(®i)- By regular variation of X 
in Bi, 

pni Y L x E[/(AA/ W )] -> / /(Ax) fi(dx) (u -+ 00), 
p (ll^ll>w) 7 Bl 

and AX is regularly varying in B 2 with limit measure /j,a = fi o A -1 . For 
measurable g : S2 —> [0, 00), by (2.4), 

g(y/\\y\\)l(\\y\\>l)fi A (dy) 

g(Ax/\\Ax\\)l(\\Ax\\ > 1) fi(dx) 

g(A9/\\A0\\)l(r\\A0\\>l)d(-r- a )X(d9) 

(A0/\\A9\\)\\A0\\ a X(d0), 



s, Jo 



yielding (6.2). □ 

The expression for Xa in (6.2) has the following probabilistic meaning: if O is 
a random element in §1 with distribution A and if U is a Uniform(0, 1) random 
variable independent of 0, then 



A8 
IA6I 
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To show (6.3), it suffices to check that E[g(A@/\\A@\\) | U < P0|| Q /|| A\\ a ] 
is equal to the right-hand side of (6.2). Equation (6.3) justifies the following- 
rejection algorithm to generate a random draw Qa from Xa'- 

1. Draw ~ A and U ~ Uniform(0, 1) independently. (6-4) 

2. If U < ||A0|| Q /||A|| a , then return A = AO/||AG|| and stop. 

3. Otherwise, go back to step 1. 

In (6.3) and (6.4), the operator norm \\A\\ may be replaced by the possibly 
smaller essential supremum of j|A0||, that is, by the left-hand side in 

inf{y > : P(|L40|| > y) = 0} ^ \\A\\. (6.5) 

Example 6.2 (Isometries) . If the linear operator A satisfies \\Ax\\ — ||^4||||a;|| for 
all x € Bi, that is, if the linear operator A/||A|| is an isometry, then the limit 
in (6.1) is just ||A|| a , and (6.2) simplifies to 

g(6)\ A (d6)= f g(A6/\\A\\)\(d6), 

that is, Xa is the distribution of A0/||A||, with a random element in Si having 
law A. 

Proposition 6.3 (Linear transformations of time series). Let (X t )tez be a 
stationary time series in Bi and let A : Bi — > B2 be a bounded linear operator. 
If (X t )tei *s regularly varying with index a > and spectral process (0t)tez and 
if AQq is not degenerate at zero, then (AX t )tez is regularly varying with index 
a > too and the law of its spectral process (0^) te z is given by 



E[/(0^,...,0f)] 

A0_., AG t 



1 

E 



ENUOolM 



\AQoW ' L40 o 



iA0 O ir 



(6.6) 



for all nonnegative integer s and t and all measurable functions f . nv 2 



t+s+l ^ R 

for which at least one of the two expectations is defined. (If ||A0o|| = 0, the 
integrand on the right is to be interpreted as zero.) 

Proof. By Proposition 6.1, 

P(\\AX \\ > u) 



P(\\X \\>u) 



E[p0 o |H («"►«>), (6.7) 



a limit which is strictly positive by assumption. For positive integer k, let fj,). be 
the limit measure in (3.3). Then by the previous display and by regular variation 
of (X t )t£Z, 

P[(AX 1 /u,...,AX k /u) e •] 



P(||AXo|| > «) 

1 

E[||i0 o 



~> T,ni 15 nrvi Mfc A 1 = : Mfe ( u 00 ) in Mo(B^) 
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It follows that the series (AX t )t£Z is regularly varying with index a > 0. Let 
(Qf)tez, be its spectral process. 

Let / : B* — > K be bounded and continuous. Since ||AX"o|| > u implies 
||X || > u/ll^ll, we have 



E 



AX- 



"AYoll""" \\AX \ 
P(\\Xq\\>u/\\A\\ 
P(\\AX q \\ >u) 



E 



AXs 
\\AX Q \ 



\Ax Q \\ > u 



AX t 



\AXn 



U\\AX \\ >u) 



\X \\>u/\\A\ 



By (6.7), regular variation of the function u i-> P(||Xq|| > u), and Theo- 
rem 3.1 (hi), the expression in the preceding display converges as u — » oo to 



\A\ 



E[||A9 |h] 



E 



AO- 



\AS \ 



\AQn 



1(Y\\AQ \\ > \\A\ 



Since Y is a Pareto(a) random variable independent of the spectral process, 
we may replace the indicator variable on the right-hand side by the conditional 
probability P(Fpe || > \\A\\ \ 9 ) = ||Ae || a /||A|| Q (observe that ||A8 || < 
\\A\\). We arrive at the right-hand side of (6.6). 

We have now shown the identity (6.6) for functions / : B| — > M that are 
bounded and continuous. As a consequence, the two probability distributions 
defined by both sides of (6.6) are equal. It follows that (6.6) is true for all 
functions / for which at least one of the two expectations is defined. □ 



by 



As in (6.3), we find that the spectral process (0^)tez of (AXt)t£Z is given 




U < 



\A@r 



\A\\ a 



(6.8) 



with U a Uniform(0, 1) random variable independent of (Qt)tei.- The rejection 
algorithm in (6.4) can be adapted in an obvious way to produce random draws 
from the distribution of (0^)tez- 



7. Infinite random sums 

Let Bi and B2 be real, separable Banach spaces. We are interested in the tail 
behavior of the B2-valued infinite random sum 

X = En T nZn (7.1) 

where (Z n ) ne i is a sequence of independent and identically distributed ran- 
dom elements in Bi and the T n : Bi —> B2 are bounded linear operators. In 
Section 8, we will extend this study to linear processes. In Euclidean space, 
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the case of random linear operators (i.e. random matrices) has been studied in 
Hult and Samorodnitsky (2008). 

We first discuss convergence of the random sum in (7.1). Assume that the 
function V defined by V{x) = P(\\Z n \\ > x) for x > is regularly varying with 
index —a for some a > and that there exists d with < 6 < min(a, 1) such 
that 

EJ|r B f<oo. (7.2) 
As E[||Z„|| 5 ] = J °° Vix 1 / 6 ) dx < oo, we have 

E[(E„ \\T n Z n \\) 5 ] < E„ E[\\Z n \\ 5 ] < co, (7.3) 

so that the series X converges almost surely. Moreover, by Rcsnick (2008, 
Lemma 4.24), the tail of \\X\\ is of the same order as the one of ||Z n ||: 

P(||X||>X) P(Zn\\Tn\\\\Z n \\ >X) || T ||^^ (7A) 

V(X) ^ V(x) ►EnIM <°° ^ 

as x — > oo. If the common law of the random elements Z n is concentrated on 
a closed linear subspace Bi o of Bi, then (7.2) may be replaced by the weaker 
condition 

E„ \\T n \\ S o < oo, (7-5) 

with 5 as before and with ||T||o = sup{||Tx|| : x G Bi j0 , \\x\\ = 1} the op- 
erator norm of the restriction of the linear operator T : Bi — > B2 to B^o; 
note that ||T|| s$ j|T||. Likewise, in (7.3) and (7.4), ||T„|| may be replaced by 
||T„||o. Further note that if a > 1 and if the innovations have expectation zero 
(Bi =62 = K), condition (7.2) is not necessary for convergence of the series X, 
although in that case the convergence does not need to hold absolutely; see for 
instance Mikosch and Samorodnitsky (2000, Lemma A. 3). 

Now assume that the common distribution of the random elements Z n is 
regularly varying with index a and spectral measure A. By Proposition 6.1, we 
have 

lim P (ll r » Z »ll >x ) = f \\ Tn 9\\ a X(d9) =: c n . (7.6) 



V(x) 



Moreover, if c„ > 0, then T n Z n is regularly varying in B2 with index a and with 
spectral measure A„ given by 

f(9) \ n (d8) = — f f(T n e/\\T n 9\\) \\T n 0\\ a X(d0) (7.7) 

for A„-integrable functions / : §2 — >• K. If at least one of the c n is positive, then 
according to the next proposition, the random series X is regularly varying 
with index a as well, its spectral measure Ax being a mixture of the spectral 
measures A„. 
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Proposition 7.1. If the common distribution of the independent random ele- 
ments Z n (n G %) is regularly varying with index a and spectral measure X and 
if the linear operators T n satisfy (7.2), then, with c„ as in (7.6), we have 

y P(\\En T nZn\\ > x) P(EJI^»|| > x) 

If ^2 n c n > 0, then the random series X = ^2 n T n Z n is regularly varying with 
index a too, its spectral measure Xx being given by 

X X = T, n PnK, (7.9) 

with X n as in (7.7) and with 

Pn = = lim P(||T„Z„|| > x | \\52 k T h Z k \\ > x). (7.10) 

Proof. Equation (7.8) follows from equation (7.6) and Proposition B.l, equa- 
tion (B.2). 

Let / : I>2 — > [0, oo) be bounded and continuous. By Proposition B.l, equa- 
tion (B.l), 

nf(E k T k z k /x)i(\\j: n T n z n \\ > x)} 

= En E [f(E k T k Z k /x) | \\T n Z n \\ > x] P(\\T n Z n \\ > x)+o{V{x)) (7.11) 

as x — > oo. Assume ^ c„ > 0. Let n € Z be such that c„ > 0. Regular variation 
of T n Z n with index a and spectral measure X n entails 

lim E[f(T n Z n /x) | \\T n Z n \\ > x] = [ f f(r9) X n (d9) d(- r - a ). 

By independence, we have 

^{T. k ^ n T k Z k /x | \\T n Z n \\ >x)= ^{T. k ^ n T k Z k /x) ^5 Q (x -»• oo). 
Combine the two previous displays to see that 

lim E[f(J2 k T k Z k /x) | \\T n Z n \\ > x] = [ f f(r9) X n (d9) d(~ r - a ). 
The latter convergence in combination with (7.8) and (7.11) implies 
lim ^nf(E k T k Z k /x)l(\\J2 n T n Z n \\ > x)} 



Vc„ f / f(r9)X n (d9)d(-r- a ) 
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We obtain 



lirn K[f(j: k T k Z k /x) | \\J2 n T n Z n \\ > 

x->oo V (X) 



5>« f°° I f(rd)K(d8)d(-r- a ). 

Jl J§2 



Equation (7.9) follows with p„ = c n /^ fc Cfc. Equation (7.10) now follows from 
Proposition B.l. □ 

Example 7.2 (Isometrics). Assume that the linear operators Tj satisfy \\Tiz\\ = 
||Tj||||z|| for all i E Z and all z S Bi, that is, the linear operators Tj/||Tj|| 
are isometries, see Example 6.2. The constants c n and p n in (7.6) and (7.10) 
respectively then simplify to 

c - P-.I-, p., = j«_ (, 12) 

for n 6 Z. The tail of ||X|| satisfies 

u^oo P(||Zo|| > W) 

If T„ is nonzero, the spectral measure A„ in (7.7) is equal to the law of TnO^/HTnH. 
with Q z a random element in Si with distribution A. The spectral measure Xx 
of X is then equal to the law of TVO z /||T/v||, with N an integer- valued random 
variable, independent of Q z and with distribution given by P(iV = n) = p n for 

n e z. 

Example 7.3 (Linear combinations with random coefficients). In case Bi = K 
we can write B2 = B and the series X is an infinite linear combination of the 
elements ipi = Tj(l) e B with random coefficients Z^: 

Since ||T,z|| = \z\ for all z s K and all i G Z, Example 7.2 applies with 
ll^ll = WtfiW- I R particular, the spectral measure of X is equal to the law of 
Q Z 4 ! n /\\iPn\\, with Q z a random variable in { — 1, +1} and TV an integer- valued 
random variable independent of Q z and distribution determined by P(N — 
n)= Pn = ||Vnir/E fc ll^ll" for all neZ. 

Example 7.4 (Linear combinations of random elements). In case Bi = B2 = B 
and Ti = a. Id with 0, £ R and Id the identity operator on B, the series X is an 
infinite linear combination of the random elements Z^ with coefficients af. 

A V.n.X,. 

Since ||Tiz|| = |a,j| ||z|| for all z € B and i £ Z, Example 7.2 applies again with 
||Tj|| = otj. The spectral measure of X is equal to the law of sign(ajy) Q z , with 
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N an integer-valued random variable independent of Q z and distribution equal 
to P(N = n)= p n = \a n \ a /J2k \ a k\ a for neN. Note that 



P[sign(ajv) = ±1] = 



En(°»)± 



where (a)± = max(±a, 0) for b6K. 



8. Linear processes 

Consider the same setting as in Section 7. Rather than a single random series, 
we now study the linear process 

x t = '£ i T i z t _ i , tez. (8.1) 

As before, (Z n ) n£ z is a sequence of independent and identically distributed ran- 
dom elements in Bi and the T n : Bi — > B2 are bounded linear operators. If the 
common distribution of the Z n is regularly varying with index a and if Resnick's 
condition in equation (7.2) holds, then the random series defining X t converges 
absolutely and (X t )t<£Z is a stationary time series in B2. Banach-spacc valued 
linear processes with light-tailed innovations (finite second moments) have been 
studied extensively in the field of functional data analysis, see for instance the 
monograph by Bosq (2000). Linear processes with regularly varying innovation 
distribution appear for instance in Davis and Resnick (1985), Davis and Resnick 
(1986), Embrechts, Kliippelberg and Mikosch (1997), Mikosch and Samorodnitsky 
(2000), and Davis and Mikosch (2008). 

Recall c n = J Si \\T n 8\\ a X(d6) in (7.6), with A the spectral measure of the 
common law of the random elements Zt. If c„ > 0, we can define a probability 
measure n n on the space Bf of B2-valucd sequences endowed with the product 
topology by 

f f(e^ s ,...,e t )K n (d(9 n ) nez ) 

'HAim MK™' (8 - 2) 

for nonnegative integer s, t and for bounded and continuous / : B^ +s+ — > K. 
Extending Proposition 7.1, we find that if J2 n Cn > 0, tne time series (X t )tez 
is regularly varying with index a > 0, the law of its spectral measure being a 
mixture of the k„ above. 

Proposition 8.1. Let the common distribution of the Mi-valued, independent 
random elements Z n (n G be regularly varying with index a and spectral 
measure A, and let T n : Mi — > B 2 be bounded linear operators. If (7.2) holds and 
ifJ2 n Cn > with c„ as in (7.6), then {X t )t£Z * n (8-1) is a regularly varying 
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stationary time series in B2 with index a, its spectral process (0t)tez having 
law K equal to 

K = J2nP" K n (8.3) 

with p n as in equation (7.10) and K n as in equation (8.2). 

The proof of Proposition 8.1 is similar to the one of Proposition 7.1 and is 
omitted. As in (7.9), equation (8.3) constitutes a mixture representation of the 
distribution k of the spectral process (0t)tez- The algorithm in (6.4) can be 
adapted in the following way to produce a random draw from k: 

1. Draw a random integer TV from (p n )nez- (8-4) 

2. Independently from N and from each other, draw Z ~ A and 
C/~Uniform(0,l). 

3. If U ||r A r0 z ]| Q /||T i v|| Q: , then return t = T N+t Q z /\\T N Q Z \\ for 
alH £ Z and stop. 

4. Otherwise, go back to step 2. 

If Q z denotes a §1 -valued random element whose distribution is equal to the 
spectral measure A of Z n , then (8.3) can be written as 



E[/(0_ s ,...,0 t )] 



1 



£„E[||T„0*|h^- 



\T n e z \\ ||T„0^| 



(8.5) 



for nonnegative integer s,t and for integrable / : B 2 +s+1 —> R; as usual, the 
integrand on the right is to be interpreted as if ||T„0 Z || = 0. 

Example 8.2 (Joint survival functions). In Example 5.1, the asymptotics of joint 
survival functions of certain random vectors associated to the time series {X t )tei 
were calculated in terms of the spectral process. By equations (5.1), (5.3) and 
(8.5), we find 



P(V» 6 I : blXj > u) E n E[min{(%r i+tl 9 z )?:ieJ}] 

- llin - p(M>.) - £ n E[||r n e*i- ' (8 - 6) 



P(V»£/:^||X t || >u) J2 n -E[min{bf\\T l+n e z \r:ieI}} 
—00 P(||X ||>u) E„E[||T„0^||«] ' [ -> 

valid for every finite set I C Z with £ / and for all linear functionals b* £ B 2 
and positive constants bi [i 6 I). If I = {0, h} for some nonzero integer h, we 
obtain expressions for certain tail dependence coefficients and extremograms 
(Examples 5.2 and 5.3). 

Example 8.3 (Extremal indices). For b* £ M% such that P(b*T n Q z > 0) > for 
some n, the extremal index 9(b*) in (5.5) of (b*X t )tez is given by 



6(b*) = 1 - 



E[min{(fo*0 o )^, sup t>1 {b*e t )%}] E[sup n (6*T„0 



Z\ 



E[(6*0 O )^] E„E[(6*T„0^)«] 
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The proof of the second equality is as follows. For the denominator, we have by 
(8.5), 

E[(6 ° o)+] - E„E[||T B e*||°] ' 

For the numerator, we have by monotone convergence and (8.5), 



E 



min<j (b*O )l, sup(6*6 t )« 



lim E 

m— foo 



mini (6*9 )+, max (6*0 t )+ 

1 < t < m 



= lim 

m— voo 



E„ E[min{(6*T„e z )^, max u ^ m (&*T n+t e z )£}] 



E n E[||r n e^||°] 

E n E[min{(6*T n e z )^,sup^ 1 (&*r„ +t 9 z )^}] 

£„E[||r n e*||°] 

For a nonnegativc sequence (a n ) ne z such that £ n a « < °°' one can snow that 
^min( a n , supa„ +t J =^a n - supa n . 



Combine the previous displays to arrive at (8.8). 

By a similar argument, the extremal index in (5.6) of (||X t ||)t e z is given by 



= 1 -E 



min<M,sup||e t |^ 



E[su Pra ||r n e 
£ n E[||T n e^h 



(8.9) 



9. Examples of linear processes 

We conclude the paper with a number of special cases and examples of regularly 
varying linear processes. We strive to get explicit expressions for the spectral 
process and derived quantities. 

Example 9.1 (Isometrics). Assume that the linear operators Tj satisfy ||Tjz|| = 
||Tj||||z|| for all i £ Z and all z 6 Bi, that is, the linear operators Tj/||Tj|| 
are isometries, see Example 7.2. The constants c n and p n in (7.6) and (7.10) 
respectively then are as given in equation (7.12). If ||T n || > 0, the distribution 
K n in (8.2) on the sequence space B z is the one of the random sequence 

Tt+n 
\Tn\\ , 

By Proposition 8.1, the spectral process of (X t )tei is given by 

i^=(^e z ) (9.i) 



T, 



N 
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with TV an integer- valued random variable independent of Q z and with distri- 
bution given by P(N = n) = p n for n G Z. For instance, the extremal-index 
formula (8.9) becomes 

= sup n ||T n l|" 

EJW 

Example 9.2 (Moving averages). Example 9.1 applies to infinite-order moving 
averages of the type 

x t = Ej Zt-iipi, t G Z, 
for random variables Z„ and deterministic ^ gl and also to moving averages 
of the type 

^( = E 1 (I i^-!. £ e Z, 

for constants a% G K and B- valued random elements Z n ; see Examples 7.3 
and 7.4 respectively. In case B = M, these two cases coincide and we recover 
the familiar framework of a linear time series in K with heavy-tailed innova- 
tions: see for instance Davis and Resnick (1985), Resnick (2008, Section 4.5), 
or Embrechts, Kliippelberg and Mikosch (1997, Section 5.5.1). We find that the 
spectral measure of X t is determined by 



ii m ^§y^ = p(e = +i) 

M^OO f( \Xt\ > U) 



= P[sign(a JV ) Q z = +1] = 



P E»K)+ +ff E„( a ») 

EnM" 



where p = P(O z = +1) = 1 — q and = max(— x,0). More generally, the 
spectral process of (X t ) te % is given by 

(0t ) tez L ( ^LqA , (9.2) 



V \ a N\ 



with N an integer- valued random variable independent of Q z and with distri- 
bution given by P(N = n) = \a n \ a /Hk \ a k\" for neZ. 

By (5.4) and (9.2), the coefficient of tail dependence between X and Xh (lag 
h G N) is equal to 

lim P(X h > u | X > u) 

= P E, t min {( a »+/Q+, (a n )+} + q E, t min{(a n+fe )^, (a ra )"} 

P £»(«»)+ + « En (°n)- 

provided the denominator is positive. The formula in (8.8) for the extremal 
index of the series (X t )t£Z specializes to 

= P sup n (a n )% + q sup„(o„)^ 



provided the denominator is positive. This expression coincides with the one in 
Embrechts, Kliippelberg and Mikosch (1997, p. 415). 
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Example 9.3 (AR(1) processes). When M% = B2 = B, a useful class of linear 
processes is given by the one of autoregressive processes of order one, AR(1) in 
short, defined by 

X t = TX t -\ + Z U t£ Z. (9.3) 

The innovations Z t are independent and identically distributed in B and T : 
M — > B is a bounded linear operator. If there exists an integer m ^ 1 such that 
|T m || < 1, then the sequence ||T n || decays at a geometric rate as n — ?> 00, so 
that (7.2) is fulfilled for every 6 > 0. Hence, if the common distribution of the Z t 
is regularly varying with index a, the AR(1) equation has a stationary solution 
given by 

x t = J2 T " z t-n, tez, 

where T° denotes the identity operator. Hence we are in the situation of Propo- 
sition 8.1 with T n = T n if n ^ and T n = if n < 0. The tail of \\X t \\ satisfies 

^ l?nfll x l = i:[\\T n o\\ a Hde) 

x^cv P(\\Z \\ > x) f-^Js 

where A is the spectral measure of the innovations Z t . In view of the term n = 0, 
the sum on the right-hand side cannot be smaller than unity. As a consequence, 
(.Xt)t 6 z is regularly varying with index a > and with spectral process as 
described in Proposition 8.1. Note that p n = for all n < and that if p no = 
for some integer no ^ 1, then necessarily p n = for all n ^ no- 

The algorithm in (8.4) for generating a random draw from the spectral process 
(@{)tez can be written as follows: 

1. Draw a random nonnegative integer N from (p n )n^o- (9-4) 

2. Independently from N and from each other, draw Q z ~ A and 
U ~ Uniform(0,l). 

3. If U < HT^e^llVll^ir, then return 

e z _ J:z*e_ w if/i>o, 
e - JV ~ N+h ~\o i(h<0. 

4. Otherwise, go back to step 2. 

In step 3, the operator norm HT^H may be replaced by the possibly smaller es- 
sential supremum of ||T iV 0' z ||, see (6.5). Note that the forward spectral process 
satisfies Q t = T'Go for t ^ 0. 

In the special case that the operator T satisfies ||T n e z || = ||T n || almost 

simplifies to 



surely for all n £ Z, then p n = ||T™|| a / ^fe>o ll^ fc || a an d the spectral process 



/ rpN+t 

( *)«=(p^ eZ W}) ( 9 - 5 ) 



where Q z ~ A and N ~ (pn)n^o are independent. 
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Example 9.4 (Sequence spaces). Let B be equal to the real sequence space 
{{x n )n^o '■ ^2 n w n\x n \ < oo}, where (w n ) n ^o is a positive sequence satisfy- 
ing Y^i n w n < 00 for some S € (0, 1); without loss of generality, assume wq = 1. 
Let (Ct)tez be an i.i.d. sequence of random variables whose common distribution 
is regularly varying with index a, where a > 6. For n £ Z, let I n : R — > B be 
the embedding I n z = ze„, with e n = (5 n ,k)k^o the nth unit vector in B. Put 

X i = (Cf,Ct-l,Ct-2,---) = ^ J nCt-n, t6Z. (9.6) 

Example 9.1 applies with ||/„| = |e„|| = w n . Alternatively, let S : B — > B be 
the shift operator defined by 

S(x ,x 1 ,x 2 ,--.) = (0,xi,a;2)---)- 
Since /„ = S n o 7 , we also have the AR(1) representation 

X t = SX t -i + Z t = X)n^0 ^ n ^t-n, t £ Z, 

with Z t = ToCt = (Ct 1 0, 0, . . .). By an application of Proposition 6.1, the ran- 
dom elements Z t are regularly varying in B with index a and spectral measure 
Xz = -S? (©S 0,0,.. .), where 8^ is a random variable in { — 1, +1} with distri- 
bution equal to the spectral measure of Ct; see also Example 6.2. However, if 
Wn+m/wn — > 1 as n — > 00 for every positive integer to, then ||S' m || = 1 for every 
such to and condition (7.2) does not apply. Still, as the distribution of Z t is 
concentrated on the closed linear subspace B = Im/ = {(x, 0, 0, . . .) : x £ K}, 
condition (7.5) is verified with ||5" Ti ||o = w m (recall wo = 1). We find that 
(X t )tem is regularly varying with index a, and by (9.5) its spectral process is 
given by 

(e t )^(^±^l {t ^v } ) , (9.7) 

with 0^ as above, independent from the positive-integer valued random variable 
N with distribution P(A = n) = p n = w"/J2k^o w t- 

If (ffin)n^o is a real sequence such that sup n \a n \/w n < 00, then we can define 
a bounded linear functional A on B by Ax = a n x n . Applying this functional 
to the sequence X t in (9.4) yields 

which, up to a change in notation, is exactly the real-valued linear process in 
Example 9.2. The results in that example can now also be recovered through 
Proposition 6.3. We leave the details for the reader. 

Appendix A: Convergence of measures 

Lemma A.l. Assume fi n — > \i in Mq(M) as n — > 00 and let f : Bq — > M. 

be bounded, measurable, and vanish on Bq u for some u > 0. Let D be the 
discontinuity set of f. If 11(D) = 0, then J f dfj, n — > J f dpi as n — > 00. 
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Proof. Let r G (0, u) be such that fj>(dBo_ r ) = 0. Let /i„ ' and /i„ denote the 
restrictions of /i„ and fj, to B \ i?o,r, respectively. By (the proof of) Theorem 2.2 
in Hult and Lindskog (2006), we have — > /j( r ) weakly. By the continuous 
mapping theorem for weak convergence of finite measures, 

I fdn n = ( fd^^f fd^=f fdfx (n □ 

Lemma A. 2. Let (S,d) be a separable metric space. Let (X n ,Y n ) and (X,Y) 
be random elements m R x S . Then (X n , Y n ) ~~> (X, Y) if and only if 

E[l(X n «C x) g(Y n )} E[1(X ^ x) g(Y)] (n -> oo) (A.l) 

for every continuity point x G R of X and every bounded and continuous func- 
tion g : S — > R. 

Proof. The 'only if part is a special case of the continuous mapping theorem. 
So assume (A.l) holds. Taking g = 1 yields _X"„ X. Taking x arbitrarily large 
so that P(A > x) is arbitrarily small yields Y n ~~> Y . As a consequence, the se- 
quence ( J n , 7„) is tight. It remains to show that the joint distribution of (X, Y) 
is determined by expectations as in the right-hand side (A.l). By Lemma 1.4.2 
in van der Vaart and Wellner (1996), the joint distribution of (X, Y) is deter- 
mined by expectations of the form E[f(X) g(Y)} with / : R — > R and g : S — ► R 
nonnegative, Lipschitz continuous, and bounded. It then suffices to write / as 
the limit of an increasing sequence of step functions whose jump locations are 
continuity points of A. □ 



Appendix B: Tails of random series 

The following result extends Lemma 4.24 in Resnick (2008). 

Proposition B.l. Let (Zi)i^ be a sequence of independent and identically 
distributed random variables taking values in a Banach space Bi . Let B2 be 
another Banach space and let Tj : Bi — > 82, % G 1, be bounded linear operators. 
Put V{x) = P(\\Zi\\ > x). If 

(i) V G RV- a for some a > 0, 

(ii) lhiLr^oo P(||TjZj|| > x)/V{x) = a, G [0, 00) exists for every i G Z, 
(Hi) y'-HTill' 5 < 00 for some < 5 < min(a, 1), 

then the series J^. TiZi is almost surely absolutely convergent and 
1 

W) 



hm ^_E|1(||E^|| > x) - E;l(im^|| > x)\ 



x^-oo 



lim wr^v^&iWTiZiW >x)- E l H\\T l z l \\ > x)\ = o. (b.i) 



V(x) 
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As a consequence, 

lim pgiE^H > X ) = lim p(Ejm^n > x) 



x—too 



V(x) x^-go V(x) 



1 V(x) = ^ ^ ' 



The meaning of Proposition B.l is that asymptotically, the series Ei TiZi is 
large in norm if and only if one of the summands TiZi is large in norm, in which 
case || J2i TiZi\\ and E< ll^i-^tll are asymptotically equivalent — the value of the 
series is determined by a single large 'shock'. The proof of Proposition B.l is 
based on a number of lemmas. 

Lemma B.2. Let X and Y be independent random elements of a Banach space 
B. Suppose that there exists V S RV- a with a > and nonnegative numbers 
a, b such that 

pp^j pot >x) 

x-too V \X) x-*oo V [Xj 

Then as x oo, 

lim J_E|l(||X + y|| >x)- \{\\X\\ > x) - 1{\\Y\\ > x)\ 



V(x) 
1 

V(x) 



= ]im —-^E\l(\\X\\ + \\Y\\>x)-l{\\X\\>x)-l(\\Y\\>x)\=0. (B.4) 



Proof. Use the formula |r| = (r)+ + (— r) + for real r to decompose the absolute 
values in (B.4). 

Fix < e < 1. For positive numbers r,s,x, if r + s > a;, then necessarily 
r V s > (1 — e)x or r A s > ex. It follows that 

1(||X + Y|| >a;) < 1(||X|| + ||Y|| >x) 

^l{\\X\\V\\Y\\>(l-e)x} + l(\\X\\A\\Y\\>ex) 
^l{\\X\\>(l-e)x} + l{\\Y\\>(l-e)x} 
+ 1(\\X\\ >ex)l(||y|| >ex). 

We find that 

\{\\X + Y\\> x) -1{\\X\\> x) -1{\\Y\\> x) 
^l{\\X\\ + \\Y\\>x)-\{\\X\\>x)-l{\\Y\\>x) 
1{(1 - e)x < \\X\\ ^x} + 1{(1 - e)x < \\Y\\ < x} 

+ >e.T)l(||y|| >ra). 
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By regular variation of V and by (B.3), 

limsup J_ E[(l(p: + Y\\ >x)- 1(\\X\\ >x)- 1(\\Y\\ > x)) ] 

x—too V \ X) 

< limsup _L E[(l(||X|| + Y > x) - 1(||X|| >x)- 1{\\Y\\ > x)) ] 



(a + b)((l-s)- a -l). (B.5) 



Since e > was arbitrary, both limits superior in (B.5) are actually zero. 
Using the inequality \\v + w\\ 1 ||v|| — ||w|| | for v, w € B, we have 

l(\\X + Y\\>x)>l(\\\X\\-\\Y\\\>x) 

= i(||x||>.x + ||y||) + i(||y||>.T + ||x||). 

It follows that 

l(\\X\\>x) + l(\\Y\\>y)-l(\\X\\ + \\Y\\>x) 

^l(\\X\\>x) + l(\\Y\\>y)-l(\\X + Y\\>x) 
< l(x< ||X|| <s+||y||) + l(a;< ||F|| 

Fix e > 0. We have 

l(x<\\X\\^x+\\Y\\) 

< l{x < \\X\\ < (1 + e)x} + 1(||X|| > x)l(||r|| > ex). 

By regular variation of V and (B.3), 

P(a; < II J^r II sj x+ \\Y\\) , . . 

limsup Li^ < o(l - (1 + e)- a ). 

:c— >oo V (X) 

By symmetry, we obtain 

i imsup J_ E [(i(||x|| >x) + i(||y|| >!,)- i(p:|| + ||y|| >x)) ] 

a;— )-oo K [X ) 

< limsup J- E[(1(||X|| > x) + l(||y|| > y) - 1(||X + Y\\ > x)) ] 



(a + fc)(l- (1 + e)~ Q ). (B.6) 



Since e > was arbitrary, both limits superior in (B.6) are actually zero. Finally, 
combine (B.5) and (B.6) to arrive at (B.4). □ 

Lemma B.3. Let X\, . . . ,X n be independent random elements of a Banach 
space B. Suppose that there exists V € RV- a with a > and nonnegative 
numbers a\, . . . , a n such that 

lim P (M >a; ) = a< , ie{l,...,n}. (B.7) 

aj-s-oo V (X) 
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Then 



Jim ^E|l(||E^|| >a: ) -E?=il(\\Xi\\ >x)\ 

= J™ ^yE|l(ELill^ll > x) - EIU^I^H >x)\=0 (B.8) 
In particular, 

lim p(e^,ii>») . Um p(a.,iwi>.) _ £ 

Proof. The proof is by induction on n, using Lemma B.2. □ 

Proof of Proposition B.l. Since Ei ll^i-^'ll ^ E» 11-^*11 ll^ill> conditions (i) and 
(iii) together with the argument on p. 225 in Resnick (2008) imply absolute 
convergence of the series E< TiZi almost surely. 

Write Xi = TiZ- t . In order to prove (B.l), let m be a positive integer. Write 

|i(]|Ei^ll>^)-E«i(ll^ll>^)| 

< |i(IIEi^ll>^)-i(IIE N<m ^ll >x)\ 

+ |l(IIE H |< m ^ll >x)~ EK|< m l(]]^ll > x)\ 

+ E M>m l(ll^ll >x). (B.10) 

The three terms on the right-hand side are treated separately. 

Consider the first term on the right-hand side of equation (B.10). Let X = 
J2\i\<^ m x i and Y = E|i|> TO ^- Using the identity \1 A - 1 B \ = 1 A ab, it is not 
difficult to see that for < e < 1, 

\l(\\X + Y\\>x)-l(\\X\\>x)\ 

sS l(||y|| > ex) + 1{(1 - e)x < \\X\\ < {l + e)x}. 

By Lemma 4.24 in Resnick (2008), since ||F|| E|i|> ro ll T ill 
limsup ffl>l), E||Tir 

V{V) |*>m 



By (ii) and (B.9), 



lim mm>£ = E a , 

y^oo V{y) 

\%\ ^.m 



By regular variation of V and from ||T^Z;|| ^ 11^1111^*11? it follows easily that 
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a L ^ 1 1 7i|| Q . In view of the three preceding displays, we have 
l imsup JL E|1(||X + F|| >x)- 1(\\X\\ > x)\ 

x^oo V(X) 

<£~ a E \\Ti\\ a +((l-e)- a -(l + e)- a ) E a t 

\i\>m \i\^m 

< z~ a E w + ((! - e )~ a - c 1 + £ )~ Q ) E n T 'ii Q - ( Rn ) 



i\ >m 



Next, for the second term on the right-hand side of (B.10), Lemma B.3 implies 
immediately that, as x — > oo, 

E|l(||E|i| <m ^ll >x)- E|i Km l(ll*iH > a;) I = o(V(x)). (B.12) 

Finally, consider the third term on the right-hand side of (B.10). Let m be 
sufficiently large such that ||Ti|| ^ 1 whenever \i\ > m. By Potter's theorem, 
there exists xo > such that V(cx)/V(x) ^ 2c~ d for every x ^ xq and c ^ 1. 
Hence 

p« >x) nmimw > x) ^ oll ^„, , . 

VYx) V7ai) < 2 II T *II> x ^ x , |i| > m. (B.13) 

As a consequence, 

Umsup-L J2 P (II^H > *) < 2 E II^H 5 - ( BJ4 ) 

a;— foo ^ IX ) 

z|>m |aj>m 

Taking expectations in (B.10) and inserting the upper bounds in (B.ll), 
(B.12) and (B.14) yields the following inequality, valid for all < e < 1 and for 
all sufficiently large integer m: 

l imsup 1 E|l(||£V*i|| >x)-'£ i l{\\X i \\ >x)\ 



V(x 

^e~ a E \\T i \\ a +((l-e)- a -(l + e)- a )J2\\Ti\\ a + 2 E H T ' 



l-MII 5 - 

|j|>m i£Z |i|>m 



First let m — y oo and then let e 1 to arrive at (B.l) for || J^i TiZi\\. The proof 
for J2i \\TiZi\\ is completely similar. 

Equation (B.2) follows from (B.l) and the dominated convergence theorem, 
the use of which is justified by (iii) and (B.13). □ 
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